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AMENDMENT(S) TO THE CLAIMS 



1. (canceled). 

2. (amended) The method as defined in Claim-4-_4, further comprising: 
receiving the encoded video object plane at the receiver from the connection; 
demultiplexing the encoded video object plane into coded video and audio 

streams; 

inputting the coded video and audio streams, respectively, into video and audio 
decoders; 

inputting the decoded video and audio streams to a media mixer; and 
inputting the mixed video and audio streams output from the media mixer to an 
output device. 

3. (canceled). 
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4. (amended) A method for transmitting a mixed media data st ream in 
packets, including audio and video objects, between a sender and a receiver through a 
connection over a network, the method comprising: 

monitoring, at the receiver, transmission characteristics of the connection between 
the server and the receiver; 

estimating available bandwidth at the sender based upon the transmission 
characteristics of the connection monitored at the receiver; 

allocating a global buffer for the mixed media data stream to be transmitted from 
the sender to the receiver as a function of the estimated available bandwidth at the sender; 

pre-encoding a portion of each Video Object Plane (VOP) in the global buffer 
with respect to a quantization parameter (OP) of the VOP; 

encoding the VOP in the global buffer based on the OP; 

updating a rate distortion model based upon the OP and packet loss rate; 

performing a frame skipping function after the VOP encodin g; and 

transmitting from the sender to the receiver the encoded video object plane in the 
global buffer at a regulated sender transmission rate from the sender as a function of the 
estimated available bandwidth at the sender; 

wherein pre-encoding a portion of each VOP with respect to the QP of the VOP 
further comprises adjusting the QP of the VOP; and 

Th e method as defined in Claim 3, wherein the QP of the VOP is adjusted with 
respect to a texture parameter, r, as the number of bits which will be used to encode the 
VOP wherein: 

p. x MAD p 0 x MAD 
QP QP 2 
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pi and p2 are control parameters; and 

MAD is a mean absolute distortion in which a total target bit rate for all objects in 
the global buffer are allocated proportionally to motion, size, and square of MAD. 

5. (original) The method as defined in Claim 4, wherein the adjusting of 
the QP of the VOP is performed by changing the QP to a values in a range from 1 to 3 1 
depending upon the estimated available bandwidth at the receiver. 
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6. (amended) A method for transmitting a mixed media data stream in 
packets, including audio and video objects, between a sender and a receiver through a 
connection over a network, the method comprising: 

monitoring, at the receiver, transmission characteristics of the connection between 
the server and the receiver: 

estimating available bandwidth at the sender based upon the transmission 
characteristics of the connection monitored at the receiver; 

allocating a global buffer for the mixed media data stream t o be transmitted from 
the sender to the receiver as a function of the estimated available bandwidth at the sender: 

pre-encoding a portion of each Video Object Plane (VOP) in the global buffer 
with respect to a quantization parameter (OP) of the VOP; 

encoding the VOP in the global buffer based on the QP; 

updating a rate distortion model based upon the QP and packet loss rate: 

performing a frame skipping function after the VOP encoding; and 

transmitting from the sender to the receiver the encoded video object plane in the 
global buffer at a regulated sender transmission rate from the sender as a function of the 
estimated available bandwidth at the sender; and 

Th e- method - as d e fin e d in C laim 1, wherein updating a rate distortion model based 
upon the QP and packet loss rate comprises: 

predicting the number of bits, r,, to encode the ith VOP, and is given by: 



. xMAD. (p^.xMAD. 




r. 



i ; i 2 i z 
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the distortion, d, is estimated by 

d. = (g l ) i x QP. + (q 2 ). x QP? + (q 3 \ x r. x (P^) . , wherein: 
qi, q 2 and q 3 are control parameters; and 

the packet loss rate (P L ); is an estimate of that the probability that the 

ith transmission of data from the sender will be lost; and 

minimizing the overall distortion, D, for each encoded VOP by D = Y,d. , subject 

i 

to R = < Rj, , where R T is the total bit budget for the current time instant. 
i 

7. (canceled). 
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8. (amended) A method for transmitting a mixed media data st ream in 
packets, including audio and video objects, between a sender and a receiver through a 
connection over a network, the method comprising: 

monitoring, at the receiver, transmission characteristics of the connection between 
the server and the receiver; 

estimating available bandwidth at the sender based upon the transmission 
characteristics of the connection monitored at the receiver; 

allocating a global buffer for the mixed media data stream to be transmitted from 
the sender to the receiver as a function of the estimated available bandwidth at the sender; 

pre-encoding a portion of each Video Object Plane (VOP) in the global buffer 
with respect to a quantization parameter (QP) of the VOP; 

encoding the VOP in t he global buffer based on the OP; 

updating a rate distortion model based upon the QP and packet loss rate; 

performing a frame skipping function after the VOP encoding; and 

transmitting from the sender to the receiver the encoded video object p lane in the 
global buffer at a regulated sender transmission rate from the sender as a function of the 
estimated available bandwidth at the sender; and 
wherein: 

the sender sends data to the receiver in through a connection over a packet switched 
network i n a sender packet having a sender header that includes: 
a packet sequence number; 

a timestamp indicating the time when the sender packet was sent (ST1); and 
the size of the sender packet (PacketSize); 
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the receiver sends data to the sender through the connection over the packet switched 
network in a receiver packet having a receiver header that includes: 

the time interval that the sender packet spent in the receiver side ( 4 _RT); 
the timestamp of the sender packet sent from the sender (ST1); 
an estimate, calculated hy the receive r, of a packet-loss r ate; and 
the rate at which data is received at the receiver; 
monitoring transmission characteristics of the connection between server and receiver 
comprises: 

estimating a round trip time of the sender packet from the sender to the 
receiver (RTT) based on ST1 and z lRT; 

estimating a time out interval (TO) before which the sender should 
retransmit to the receiver a sender packet of data that has not been received 
by the receiver; 

estimating a probability that a packet of data will be lost (V\ ); 

estimating the present available network bandwidth at which the 
receiver can receive data from the sender (rvcrate) as a function of the 
PacketSize. the RTT. the P L . and the TO: 

deriving the present sending rate of data from the sender to the re ceiver 
{currate% 

setting an updated sending rate of data from the sender to the receiver 
(currate), wherein: 

if rcvrate is greater than currate , then deriving currate as a 

function currate , PacketSize, and RTT; and 
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if rcvrate is not greater than curra te , then setting currate to be less than rcvrate; 

and 

The method as defined in Claim 7, wherein: 
RTT = a x RTT + (l-a)x (now-STl - ART) ; and 
now is the timestamp indicating the time at which the receiver packet was 
received in the sender; and a is a weighting parameter. 
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9. (amended) A method for transmitting a mixed media data stream in 
packets, including audio and video objects, between a sender and a receiver th rough a 
connection over a network, the method comprising: 

monitoring, at the receiver, transmission characteristics of the connection between 
the server and the receiver: 

estimating available bandwidth at the sender based upon the transmission 
characteristics of the connection monitored at the receiver; 

. allocating a global buffer for the mixed media data stream to be transmitted from 
the sender to the receiver as a function of the estimated available bandwidth at the sender; 

pre-encoding a portion of each Video Object Plane (VOP) in the global buffer 
with respect to a quantization parameter (OP) of the VOP; 

encoding the VOP in the global buffer based on the QP; 

updating a rate distortion model based upon the QP and packet loss rate; 

performing a frame skipping function after the VOP encoding; and 

transmitting from the sender to the receiver the encoded video object plane in the 
global buffer at a regulated sender transmission rate from the sender as a function of the 
estimated available bandwidth at the sender; and 
wherein: 

the sender sends data to the receiver in through a connection over a packet switched 
network in a sender packet having a sender header that includes: 
a packet sequence number; 

a timestamp indicat in g the time when the sender packet was sent (ST1); and 
the size of the sender packet (PacketSize); 
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the receiver sends data to the sender through the connection over the packet switched 
network in a receiver packet having a receiver header that includes: 

the time interval that the sender packet spent in the receiver side ( j _RT); 
the timestamp of the sender packet sent from the sen der (ST1); 
an estimate, calculated by the receiver, of a packet-loss rate; and 
the rate at which data is received at the receiver; 
monitoring transmission characteristics of the connection between server and receiver 
comprises: 

estimating a round trip time of the sender packet from the sender to the 
receiver (RTT) based on ST1 and ^RT; 

estimating a time out interval (TO) before which the sender should 
retransmit to the receiver a sender packet of data that has not b een received 
by the receiver; 

estimatin g a probability that a packet of data will be lost (P L ); 

estimating the present available network bandwidth at which the 
receiver can receive data from the sender (rvcrate) as a function of the 
PacketSize, the RTT, the P L . and the TO: 

deriving the present sending rate of data from the sender to the receiver 

[currate }± 

setting an updated sending rate of data from the sender to the receiver 
(currate), wherein: 

if rcvrate is greater than currate , then deriving currate as a 

function currate , PacketSize. and RTT; and 
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and 



if rcvrate is not greater than curra te , then setting currate to be less than rcvrate; 

- T - h e- m e thod as defined in Claim 7, wherein: 
TO = RTT + (kx RTTVAR) ; 
k is a constant; 



RTTVAR = a 2 x RTTVAR + (l-a 2 )x \RTT - {now - ST1 - ART)\ : 



RTTVAR is the current variation in the round trip time of the sender packet from 
the sender to the receiver (RTT); 

a2 is a weighting parameter; and 



RTTVAR is a smoothed estimate of RTTVAR . 



10. (canceled). 
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11. (amended) A method for transmitting a mixed media data stream in 
pa ck e ts, including audio and video objects, between a sender and a receiver through a 
connection over a network, the method comprising: 

monitoring, at the receiver, transmission characteristics of the connection between 
the server and the receiver; 

estimating available bandwidth at the sender based upon the transmission 
characteristics of the connection monitored at the receiver; 

allocating a global buffer for the mixed media data stream to be transmitted from 
the sender to the receiver as a function of the estimated available bandwidth at the sender; 

pre-encoding a portio n of each Video Object Plane (VOP) in the global buffer 
with respect to a quantization parameter (OP) of the VOP; 

encoding the VOP in the global buffer based on the OP; 

updating a rate dist ortion model based upon the QP and packet loss rate; 

performing a frame skipping function after t he VOP encoding; and 

transmitting from the sender to the receiver the encoded video object plane in the 
global buffer at a regulated sender transmission rate from the sender as a function of the 
estimated available bandwidth at the sender 
wherein: 

the sender sends data to the receiver in through a connection over a packet switched 
network in a sender packet having a sender header that includes: 
a packet sequence number; 

a timestamp indicating the time when the sender packet was sent (ST1); and 
the size of the sender packet (Packets ize); 
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the receiver sends data to the sender through the connection over the packet switched 
network in a receiver packet having a receiver header that includes: 

the time interval that the sender packet spent in the receiver side ( _£ RT); 
the timestamp of the sender packet sent from the sender (ST1); 
an estimate, calculated by the receiver, of a packet-loss rate; and 
the rate at which data is received at the receiver; 
monitoring transmission characteristics of the connection between server and receiver 
comprises: 

estimatin g a round trip time of the sender packet from the sender to the 
receiver (RTT) based on ST1 and A RT; 

estimating a time out interval (TO) before which the sender should 
retransmit to the receiver a sender packet of data that has not been received 
by the receiver; 

estimating a probability that a packet of data will be lost (P i); 

estimating the present available network bandwidth at which the 
receiver can receive data from the sender (rvcrate) as a function of the 
PacketSize. the RTT, the Pi , and the TO; 

deriving the present sending rate of data from the sender to the receiver 
£ currate }; 

setting an updated sending rate of data from the sender to the receiver 
(currate), wherein: 

if rcvrate is greater than currate , then deriving currate as a 

function currate , PacketSize, and RTT; and 
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if rcvrate is not greater than currate , then setting currate to be less than rcvrate; 

wherein is derived by a Gilbert Model; and 
The m e thod as d e fined in Claim 1 0, 
wherein: 

A 

P =-2— 

L A A' 

p+q 



Xj takes 1 if the ith sender packet has arrived successfully at the receiver; 
Xj takes 0 if the ith sender packet is lost; 
P = P[X i =l\X i _ l =0]; 

q-PlX^OlX^ = 1]; 

A 

p is an estimate of p; 

A 

q is an estimate of q; and 

A A 

p ~ "qj/^q an d <7 = "jo/"i ' wnerem: 

noi is the number of times in an observed time series when one 
follows zero; 

n J0 is the number of times when zero follows one; 
no is the number of zeros; and 

ni is the number of ones. 
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12. (original) The method as defined in Claim 1 1 , wherein: 

the P L is further smoothed by a filter that weights the n most recent 
measured packet loss rates by: 

j=0 



1 

L > l ~ J is the measured packet loss rate in the (i-j)th time interval; 
two set of weighting parameters are defined as follows: 





wo 


Wl 


W2 


W3 


W4 


W5 


W6 


W7 


WS1 


1.0 


1.0 


1.0 


1.0 


0.8 


0.6 


0.4 


0.2 





WO 


Wl 


W2 


W3 


W4 


W5 


W6 


W7 


WS2 


1.2 


1.2 


1.0 


1.0 


0.8 


0.5 


0.3 


0.1 



; and WS2 is used for wj when the actual packet loss rate is less 
than half of the measured packet loss rate, otherwise WS1 is used 



for wj. 



13. (amended) A computer-readable media comprising computer- 
executable instructions for performing the method as recited in Claim-41 1 . 



14. (canceled). 
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15. (amended) A method for transmitting a mixed media data stream in 
packets, including audio and multiple video objects (MVQs), between a sender and a 
receiver through a connection over a network, the method comprising: 

monitoring transmission characteristics of one or more encoded video object 
planes through the connection between the sender and the receiver; 

estimating, from the transmission characteristics, an available bandwidth (RT) at 
the sender; 

allocating, as a function of the RT, a portion of the mixed media data stream to a 
global buffer; 

encoding a video object plane from the global buffer based upon a rate distortion 
function that accounts for packet loss rate between sender and receiver; 

updating the rate distortion function based upon results of the encoded video 
ob ject plane and upon a memory containing results of one or more p reviousl y encoded 
video object planes; 

after the encoding the MVQs in the video object plane, performing a frame 
skippin g function; and 

transmitting, at the estimated available bandwidth, the encoded video object plane 
from the sender to the receiver; 

The method as d e fin e d in Claim \A, 

wherein allocating a portion of the mixed media data stream to a global buffer 
comprises: 

W = m<xx(((W +B ) x R ! R - R IF), 0) , as the global buffer 
cur prev prev' Ti old Tl 

size Roid/2, is changed to Rj/2, wherein: 
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Bp rev is the number of bits spent in the previous time instant Bp rev , 

Rcid/2 is the previous size of the global buffer; 

Wp r ev is the previous occupancy of the global buffer; and 

F is the video frame rate. 

16. . (amended) The method as defined in Claim Ml 5, wherein allocating a 
portion of the mixed media data stream to a global buffer comprises the allocation of an 
output target rate from the global buffer among each of video and audio data streams so 
as to yield the target bits for an individual object in the data stream, 

17. (amended) The method as defined, in Claim 4415, further comprising: 
receiving the encoded video object plane at the receiver from the connection; 
demultiplexing the encoded video object plane into coded video and audio 

streams; 

inputting the coded video and audio streams, respectively, into video and audio 
decoders ;-and 

inputting the decoded video and audio streams to a media mixer; and 
inputting the mixed video and audio streams output from the media mixer to an 
output device. 

18. (amended) A computer-readable media comprising computer- 
executable instructions for performing the method as recited in Claim 4415. 

19. (canceled). 
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20. (canceled). 



21. (canceled). 



22. (canceled). 



23. (canceled). 



24. (canceled). 



25. (canceled). 



26. (canceled). 



17 27. (canceled). 



28. (canceled). 

29. (canceled). 

30. (canceled). 

31. (canceled). 

LEE 5 Hayes, mc 21 MSl-05S9US.Reply.To.l0-05-2005-Nff>A 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



32. 



(canceled). 



33. (canceled). 

34. (canceled). 

35. (new) A computer-readable media comprising computer-executable 
instructions for performing the method as recited in Claim 4. 

36. (new) A computer-readable media comprising computer-executable 
instructions for performing the method as recited in Claim 6. 

37. (new) A computer-readable media comprising computer-executable 
instructions for performing the method as recited in Claim 8. 

38. (new) A computer-readable media comprising computer-executable 
instructions for performing the method as recited in Claim 9. 
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